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Abstract. We present examples of how time-symmetric kinetic factors contribute to the 
response either in nonlinear order around equilibrium or in linear order around nonequilibrium. 
The phenomenology we associate to that so called frenetic contribution are negative differential 
conductivity, changes in the Einstein relation between friction and noise, and population 
inversion. 


1. Introduction 

Understanding how a system responds to an external stimulus is both interesting and important. 
Questions include how to predict it and to identify on what it depends. We could for example 
suspect from general intuition that the response of an observable would be related to its vari¬ 
ance; the system is more susceptible to external stimuli if it shows already larger fluctuations 
in its unperturbed condition. An early example of that connection was the Sutherland-Einstein 
relation which gives the mobility proportional to the diffusion constant for particles suspended 
in an equilibrium fluid mm- The equilibrium fluctuation—dissipation theorem generalizes that 
idea and the (Green-)Kubo formulae relate the linear response coefficients of an equilibrium 
system to correlation functions in the unperturbed system mm- More precisely, they tell us 
that to linear order around equilibrium the response is given by a correlation of the observable 
with the entropy flux generated by the perturbation. Let us start by a newer view on that result. 

When dynamics enters into the statistical description of physical systems it appears useful 
to consider dynamical ensembles [S]. On the formal side those are very reminiscent of what we 
more generally call path-space integration. One considers a system on a coarse-grained level with 
states X and we denote the possible trajectories over time-interval [0, t] by a; = (xt-,0 <T<t). 
The states x can be values of macroscopic variables or they could denote the position and 
momenta of some particles etc. The state evolves in time and we can first consider an 
equilibrium process where the path probabilities are time-reversal symmetric: the probability of 
each trajectory satisfies 

Prob[a;] = Prob[0a;] 

where 9uj denotes the time reversed trajectory obtained by inverting the the time-sequence of 
states and, if the state involves velocities, also flipping the sign of all velocities. The above 
relation gets often described as microscopic reversibility or detailed balance. 

We now start the system in equilibrium at time zero but then by a perturbation the system 
is pushed out and its statistics follows another dynamical ensemble with probabilities 

Prob'^fcj] = Prob^ 


( 1 ) 


where the superscript h stands for the amplitude of the (unspecified) perturbation and A = 
is called the action of order h. We want to know the value of some path-observable 0{uj) during 
[0, t]. We can compute its expectation value as follows: 

{0{lo))^ = ^ 0(a;) Prob[w] and similarly 

UJ 

{0{Bu;))^ = ^O(0w)e-^(‘^)ProbM 

U) 

= ^0(a;)e-^('^‘^)Prob[cu] 

UJ 

(The sums over the trajectories uj are a bit formal but that does not matter here.) By subtracting 
the last line from the first line we thus obtain 

(0(a;))"-(0(M>" = EO(^) 

UJ 

Such formulae are useful for response theory. For example, we can take for observable O a particle 
current (where 06 = —O) or even simpler we can choose 0{u}) = 5{xt — x), the indicator to be 
in state x at the final time t. In the last case we find 

Prob^[xt = x] - Prob'^[xo = x] = 

uj:xt=x 

Using that in the reference equilibrium, Prob[xi = x] = Prob[xo = x] and since at time zero 
Prob^[xo = x] = Prob[xo = x], the perturbation is not yet visible, formula Q gives the change 
by the perturbation as 

Prob^[xt = x]-Prob[xi = x] = E 

uj:xt=x 

Response theory was first systematically developed some 60 years ago for dynamical ensembles 
that have a time-reversal symmetry and when the perturbation can be taken very small. That is 
the context of linear response theory around equilibrium. While that is not the usual textbook 
presentation, the above can be applied immediately. We should expand the exponential to first 
order in h (linear order perturbation theory). Then (|^ simplifies to 

Prob^[xt = x] — Prob[xt = x] = E [^{6oj) — A{oj)] Prob[cu] (5) 

UJ\Xt =x 

and we see that the linear response formula around equilibrium is completely expressed by the 
time-reversal antisymmetric part A[0u) — A(uj) of the action that describes the perturbation. 
That is interesting because in many situations that antisymmetric part has a clear physical 
meaning. That measure of time-reversal breaking is indeed related to dissipation and entropy 
fluxes, at least if the environment of the system remains in local thermal equilibrium. That 
makes the relation between linear response around equilibrium and entropy fluxes, as summa¬ 
rized in the fluctuation-dissipation theorem one of the manifestations of what we can call the 
miracle of equilibrium: there is basically a unique entropy, having many faces in terms of differ¬ 
ent thermodynamic potentials, that governs heat exchange with the environment via Clausius 
theorem, appears as a time-increasing function in Boltzmann’s H-theorem, characterizes macro¬ 
scopic fluctuations in the system as pioneered by Planck and Einstein, specifies the statistical 


Prob[a;] (4) 


Probfcj] (3) 


_ g-A(0aj) 


Prob[a;] 


( 2 ) 






forces as clarified by Onsager and, as explained above, also decides the linear response as devel¬ 
oped by e.g. Kubo. 

We can hope for more life (but maybe less luck) if the reference system is out of equilibrium 
or when considering nonlinear response around equilibrium. Energy-entropy considerations 
only are most likely not enough to characterize nonequilibrium systems. In fact it would be 
very surprising if the details of the dynamics would not matter much more for stationary 
nonequilibrium conditions. Kinetic factors encoded in friction or reactivities will show up in 
the stationary state weights and no guarantees exist about a purely thermodynamic meaning 
of fluctuation or variational functionals. This immediately implies that nonequilibrium theory 
cannot just be nonequilibrium thermodynamics and in general one has to go beyond the concept 
of entropy and work to construct nonequilibrium statistical mechanics. 

Indeed, ([^ will be false and the physics of the time-symmetric part in the action A comes to 
the foreground. That corresponds to a different physics; when a perturbation is applied around 
a nonequilibrium condition, kinetic factors, apart from entropy, start to play a key role ElEj. 
Similarly for higher order response around equilibrium, these kinetic factors appear explicitly 
[8]. By ‘kinetic factors’ we generically refer to the non-thermodynamic aspects like exact details 
of couplings of a system with a reservoir or time-symmetric Arrhenius prefactors in transition 
rates — quantities which are irrelevant in the study of static equilibrium linear response. A 
priori, this seems a formidable scenario — there could be many possible ways to perturb a sys¬ 
tem which are different kinetically but equivalent thermodynamically. Is there a generic method 
to describe response theory beyond the equilibrium fluctuation-dissipation relation? Luckily, it 
turns out that the answer is yes. The notion of ‘frenesy’ or dynamical activity, which is a time- 
symmetric quantity, allows us to provide a unihed framework to study nonequilibrium response 

m- 



Figure 1. Schematic representation of the phase space of a macroscopic system. In equilibrium, 
which corresponds to the largest region, only volume (entropy) is relevant while surface effects 
(reactivity and escape rate) are substantial when the system is in a smaller region corresponding 
to some nonequilibrium stationary state. Reactivities are symmetric, suggested here by having 
exits equal to entrances between any two regions. 


Frenetic contributions have already been described in studies of nonequilibrium system in 
various contexts. It is the key quantity leading to negative differential mobility for particle 
transport in disordered systems or constrained geometries [HI [TO]. The dynamical activity is 



also an important player in studies of kinetically constrained models HU or glass transitions 
m Experimental studies of micro-swimmers also pick up the signature of this time-symmetric 
quantity m- On a more theoretical level we see the frenetic contribution as a complement to 
entropic considerations. The latter ultimately refer to estimates on phase space volumes for 
a physical coarse-graining of the energy surface corresponding to the appropriate closed and 
isolated universe containing our system. Volumes in phase space are especially important if the 
differences are large, with the equilibrium condition taking in fact almost all volume in phase 
space (see Fig. [^. When well away from that largest volume, it does not seem unreasonable 
to think that also “surfaces” of phase space regions get important in the sense that the exit 
and entrance rates of the regions start much more there to influence response and fluctuations. 
That time-symmetric traffic between different conditions (phase space regions) is what we have 
in mind with dynamical activity and the frenetic contribution manifests itself via correlation 
functions with such a traffic or dynamical activity. 


The aim of this article is not to provide a comprehensive review of these studies, rather to 
illustrate how frenetic aspects lead to some interesting phenomena with the help of some simple 
examples. Relevant references are provided for more detailed studies, wherever necessary. In 
the next section we give a brief account of the theoretical background of response away from 
equilibrium; the relevant response formulae, derived from a path-ensemble formalism are quoted. 
The precise meaning and definition of dynamical activity is also illustrated in the context of 
Markov jump processes. In Sec. [^we move on to a few chosen examples starting with the toy 
model of a biased random walker. How negative differential mobilities can arise in presence of 
‘trapping’ in the system is discussed next. Section ^ focuses on higher order response around 
equilibrium which picks up kinetic details in the coupling with the reservoir. The last example 
in Sec. 3.4 explores the effect of population inversion on energy transport in a simple setting of 
a multilane stochastic particle system. The population inversion is again caused by a suitable 
kinetic aspect. We conclude with some general remarks about nonequilibrium response theory. 


2. Response formulae 

In this section we give a brief review of the relevant response formula. That is meant to establish 
the notation and to explain the concepts rather than to prove them. We refrain from giving the 
derivations but the references will point to more reviews. 



Figure 2. An open system in contact with spatially separated equilibrium reservoirs satisfies 
local detailed balance. 

Q makes sense also outside equilibrium, i.e., for a reference dynamical ensemble that is not 





time-reversal symmetric. In a way 0 defines what are the possible perturbations that we 
can consider via the path-space formalism. For the physics we move now to the context of 
open systems in contact with multiple spatially well-separated equilibrium reservoirs (see Fig. 

). For systematics it is then useful to decompose the action into its time-antisymmetric and 
time-symmetric components, 

Sh:=Ae-A, Dh:=\{A + Ae), A = Dh - 

They come with a physical interpretation. That is most clear and familiar for 


Sh{uj) = log 


Prob'^[w] 

Prob^[0a;] 


log 


Prob[a;] 

Prob[0a;] 


giving a measure of the excess in time-reversal breaking by applying the perturbation. When 
the system is in weak contact with spatially separated equilibrium reservoirs, that time- 
antisymmetric part can be identified with the entropy flux (per ks) into that environment 
along the path uj. It is in other words a thermodynamic quantity related to heat and 
dissipation of work, and the reason is summarized as the condition of local detailed balance; see 
laiiaEaEiKiziiii]. Also the dynamical activity Dh{uj) is identified for each trajectory w; it 
is time-symmetric and its role and meaning is part of the questions in today’s attempts towards 
constructing nonequilibrium statistical mechanics. Also this paper will contribute to illustrating 
its nature. For being more specific we illustrate below, using the example of a Markov jump 
process, how these quantities can be computed for a given dynamical ensemble mill do]. 


2.1. Linear response around nonequilibrium 

Formula Q implies that {0{u}))^ = {e~^^‘^'^ 0 {uj))^. That immediately gives the linear 
differential response to the perturbation, 

( 0 ( 1 ..))'“ = \ (0(OJ);SM)'- - ( 6 ) 

{f]g) denotes the covariance between the observables f,g and are first derivatives with 

respect to the drive h. The averages (•)^ are over trajectories including possibly the initial 
conditions and depending on the driving field h. We will often drop the explicit dependence on 
h in the notation. Thus, the first term in Q signifies the covariance or the connected correlation 
of the observable O with the linear excess of entropy generated due to the perturbation and the 
second term arises from the correlation with the change in dynamical activity. Note also from 
that whenever O only depends on the initial state xq, then the left-hand side is zero and so 
must the right-hand side 


^ (O(xo); = (O(xo); (7) 

which relates the entropy flux with the dynamical activity. Also observe that we can take as a 
special case 0{uj) = Sq{u)) in Q, to find 

= I - {S'oiciy.Dyiw))’' ( 8 ) 

where the first term is always positive. In fact, the observable Sq{u}) is time-antisymmetric and 
refers to an excess of entropy flux carried by the different currents in the system. The for¬ 
mula Q is therefore an extended Green-Kubo formula (in the Helfand form) for the differential 




transport coefficients. We remark also that from ®-(§ we can obtain the Harada-Sasa equal¬ 
ity connecting energy dissipation with the violation of the usual fluctuation-response relation, 
[SIES]. Finally we feel that it makes sense to make a connection here with the notion of effective 
temperature. Effective temperature from the response formula Q can be defined by dividing 
that formula by (0(w); In the case of equilibrium that would give the (real thermody¬ 

namic) temperature; for nonequilibrium, there is a correction involving the frenetic contribution. 


Let us look again at the special case of perturbing around equilibrium /i = 0. In that case, 
if the observable O is antisymmetric under time-reversal, e.g. being a time-integrated energy or 
particle current 0(cu) = J{io), then {J{io); Dq{uj))^ = 0 because the dynamical activity Dh{uj) 
in Q is itself time-symmetric and the equilibrium process is time-reversal invariant. Thence, 

= LjM;S;M)“ (9) 

h=0 ^ 

That equilibrium result is the well-known Green-Kubo relation for equilibrium conductivities. 
We will see it more explicitly in later examples. Another special case is when the observable is 
a state function 0{io) = 0{xt). Then, in equilibrium, Q reduces to the Kubo formula, 

= (0(xi);5'(a;))° = (0(xt)5'(u;))° (10) 

h=0 

The first equality follows from 

= (0(xo)D(,(a;))0 = ^{0{xo)S^,{u))^ = -^{0{xt)S',{io)f 

where we have used Q for the middle equality. All the other equalities follow by time-reversal 
invariance of the equilibrium process 






For the response in Q-(IO) around equilibrium it suffices to know how the perturbation 
affects the entropy flux (or, excess dissipation in the environment). Away from equilibrium, 
however, the frenetic contribution (0(w); D^o;))^ in Q involving the dynamical activity D{uj) 
plays a major role. As we will see later, this D(uj) explicitly involves ‘kinetic factors’ like 
escape rates, symmetric prefactors or diffusion constants, which implies that the nonequilibrium 
response formula carries more detailed information about the system than the equilibrium one. 


2.2. Higher order response 

Using dynamical ensembles allows one also to easily investigate higher order responses. In 
particular, to second order the general nonequilibrium response formula takes the form 

+ \((S'„(^)fO{^)t - (S'd^)D'^[^)OW)t ( 11 ) 

Here we have assumed that = 0, i.e., the entropy flux Sh is linear in the field h which is true 
for most physically relevant examples of perturbations. Unsurprisingly, the dynamical activity 
appears explicitly in this nonequilibrium second order response formula. What is interesting is 
that the frenetic effects become important even when one looks at response around equilibrium 
from second order onwards. In particular for a time-antisymmetric observable J{uj), and the 





perturbation around equilibrium /i = 0 one obtains the second order correction to the Green- 
Kubo formula [S], 


d/l2 


(Jiu,))'' 


h=0 




( 12 ) 


The extension of the Kubo formula for a state observable 0{xt) is the second order response 
around equilibrium, 


d/i2 




h=0 




(13) 


Indeed the above expressions depend explicitly on the excess in the dynamical activity Dq gener¬ 
ated by the perturbation while the first order, as given by (10), does not. The direct implication 
is that perturbations which are thermodynamically equivalent — generating the same entropy 
fluxes but differing in kinetic details, would have different second order responses. 


Before we discuss the frenetic aspects of response in more details with the help of several 
physically motivated examples let us make more explicit the quantities Sh{uj) and D^ico) for 
systems modelled by Markov jump processes. We consider a Markov jump process specified by 
transition rates k{x, y) for jumps x ^ y between states x, y. These are parametrized by the 
time-antisymmetric and symmetric s{x,y) and 'ip{x,y) respectively 

k{x,y) = 

il}{x,y) = il;{y,x) >0, s{x,y) =-s{y,x) (14) 

all possibly depending on the field or potential with amplitude h. A trajectory u := (xr,0 < 
T < t) over time interval [0, t] is characterized by discrete jumps at times Tj and by exponentially 
distributed waiting times Tj+i — Tj. The entropy flux and dynamical activity associated with this 
trajectory (up to some additive constants which depends on the reference process) are 

5'ft(w) = '^s{Xri,Xri+^) 

i 

Dh{uj) = / dr^(xr) - Vlog'!/’(a:ri,Xri+i) (15) 

Jo 


where ^(x) = Yhy y) is the escape rate at state x. The dynamical activity is time-symmetric; 
reversing the time over the trajectory in [0, t] does not change it. It consists of two contributions, 
the reactivities 'ip and the escape rates These are the kinetic factors that become particularly 
significant away from equilibrium. One of the interesting questions is to discover how ip is 
influenced by the nonequilibrium condition and how it changes with h. The response will 
teach us about some of that dependence. On the other hand, Sh is time-antisymmetric and 
corresponds to the thermodynamic entropy flux over [0, t] when the condition of local detailed 
balance is satisfied. Then s{x,y) denotes the entropy flux to the environment (per ks) in the 
transition x ^ y. The excess entropy and dynamical activity produced by the perturbation is 
calculated from the above Eq. (15) and must be used in the relevant response formulae (§, (0 
or (13). Note that under (global) detailed balance s{x,y) = l3[U{x) — U{y)] for some potential 
U, and then the stationary equilibrium distribution ~ exp[—/3[/] is completely independent of 
the prefactors ip{x,y). 


3. Examples 

In this section we discuss several examples where kinetic factors play an important role in the 
response behaviour. 







3.1. Toy model: ID Random walk 

Our first example is a toy model of a biased one-dimensional random walk on a lattice which, 
despite being extremely simple, serves as a paradigmatic example to illustrate the notions of 
kinetic factors and frenetic contributions appearing in nonequilibrium response. 

Let us consider a one-dimensional nearest neighbour continuous time random walk specihed 
by rates p and q of jumping to the right, respectively left neighbour (see Fig. [^. In the 


parametrization (14) 


P 

X ± 1) = s(x, X ± 1) = ± log-, xGZ 

Q 


q p 

— • — • — • — • — • — • — • - 

Figure 3. The usual parametrization for a continuous time biased random walk. 

Equilibrium dynamics corresponds to p = q. Away from equilibrium, the local detailed 
balance condition characterizes the ratio of rates, 

log - = jdE 

q 

for an environment at temperature and with external field E to the right. The symmetric 
prefactor or the reactivity V’ however is not specified yet by that condition. In general, one can 
imagine that ij: = ^l:|s{E) is also affected by the field E; the exact functional form would depend 
on the specific way the system is coupled to the environment and the driving agency. The walker 
is just an effective or reduced description of a possibly much more complicated process. 
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Figure 4. Linear response for 1-dimensional biased random walk, (a) The differential 
conductivity along with its entropic and frenetic components are plotted as a function 
of the bias E. (b) The same for the time-symmetric traffic (n). Here '0/3 (-®) = exp(—/3E). 


We look now at the differential response when the drive E ^ E + dE. It is needless to say 
that for this simple random walk model all the physical properties can be calculated exactly, and 















one does not require linear response theory to compute the effect of the perturbation. Again, 
this biased random walker acts as an effective model for studying negative differential response 
in particle transport. 


The entropy flux and dynamical activity for a given trajectory uj are given by (15) 


Sioj) = (N+ - iV_) log - = pEJ 

q 

D{u) = {p + q)t--{N++N_)logpq 

BE 

= 2il)/i{E)cosh^t - Nlog'll)p{E) 

where and N- denote the number of jumps in [0, t] to the right and the left respectively. 
J = Nj^ — N- is the time-integrated current along the field and N = A_|_ + A_ is the ‘traffic’ 
i.e. the total number of jumps during the interval [0,t]. The primary observable of interest is 
the current J; the differential conductivity is then predicted using ([^ and writing h = E, 




/3il)(3{E) cosh ^ + 2'il)'p{E) sinh ^ 


(16) 

(17) 


The first term in (16), the variance of the current J, is the positive entropic contribution. The 


correlation {N;J) arises from the reactivity and note that it vanishes in equilibrium {E = 0). 
In other words the change in the prefactor 'ip^{E) as function of E remains unnoticed in linear 
response around equilibrium. The interesting scenario is when the second term contributes 
sufficiently negatively yielding a negative differential response. From we see what is needed 
— '4)'p{E) should be ‘sufficiently’ negative. Fig. ®a) shows the differential conductivity for such 
a choice of 'il)^{E) = exp(—/3i7). For the sake oiconvenience we have used the current per unit 
time j = J/t as the observable; the entropic and frenetic contributions are also shown separately. 

Similarly, one can also look for the response in the traffic N = + N -, 


/3il)(3{E) sinh ^ -h 2'i/)'f^{E) cosh ^ 


(18) 


Note that there the variance of N appears in the frenetic term. That was seen already in the 
context of linear response for the boundary driven zero range process m- In fact, since N is 
time-symmetric the role of entropic and frenetic contribution gets reversed; even for E = 0 we 
get only the frenetic part. That is reminiscent of the situation for the momentum current in 
shear experiments. The viscosity is then in fact frenetic and not entropic. That similarity has 
been discussed in e.g. [2T]. 

Fig. I^b) shows the response and the entropic and frenetic components separately for (n) = 
{N)/t, the average number of undirected jumps per unit time. We see that the differential 
response for (n) is negative for this specific choice of iplE). 

The second order response for the current J around equilibrium also immediately follows 
from Eq. (12), 


dE2 


iJiu)) 


= -(S'(u))D'o(u))J(u)}}^ 


E=0 













= -/3 

= 2/34(0)i 


2V'^(0)t(j2)0 - 


V^/3(0) 


Clearly that second order response now depends explicitly on how the reactivity "0 changes with 
the driving E. In particular, as already mentioned in the previous section, perturbations which 
are equivalent thermodynamically i.e., produce the same entropy fluxes but differ in their effect 
upon the kinetic prefactor would generate separate second order responses. 


3.2. Trapping effect: negative differential mobility 

Mobility of a particle quantifies how its velocity changes when subjected to an external mechani¬ 
cal force. Requirements for thermodynamic stability ensure that the mobility is strictly positive 
around equilibrium i.e the velocity or current increases when the applied force is larger. This 
is a consequence of the fact that the equilibrium mobility, as given by the Sutherland-Einstein 
relation, is nothing but the variance of the current in the unperturbed state. This statement is 
no longer true when the system is driven far away from equilibrium, where the frenetic contribu¬ 
tion becomes relevant, |22j . There one speaks about the differential mobility which characterizes 
how the current changes with the drive. One of the consequences of the modified Kubo formula 
is that negative differential mobilities are allowed to exist, i.e., the current need not be a mono- 
tonically increasing function of the drive. 


E 




Figure 5. Driven particle motion in constrained geometry giving rise to trapping. Colloid 
particles (dark green discs) tend to reside inside the cages created by the obstacles when pushed 
hard. The blue dots represent the equilibrium medium. 

Several studies of negative differential mobility in nonequilibrium particle systems can be 
found in the literature. Examples include particles diffusing in restrictive or confined geometries 
[lOL l2^ I24| . driven lattice Lorentz gas |25[ I26| . driven particle in an environment of mobile 
obstacles and exclusion processes with constrained dynamics |21) . 

To understand the origin of such negative differential mobility from a general viewpoint let us 
look at Eq. ([^ where O = J, the time-integrated current, in what we imagine as a driven 
particle system. The excess entropy is essentially proportional to the current itself implying the 
positivity of the entropic term. A large negative contribution from the frenetic term, however, 
could result in an overall negative differential response of the current. 

It was shown in [101 123] that this indeed might happen if there is a possibility of trapping in 
the system. Intuitively that is quite easy to understand — if the particles get trapped then the 








dynamical activity is affected and if it so happens that the trapping or caging increases when 
the perturbing field becomes stronger then negative differential mobility can occur. A simple 
example is the driven motion of colloids in a narrow channel in presence of directed ‘cages’ or 
obstacles (Fig. [^; the particles get more and more trapped when the driving force is increased 
resulting in a decrease of the current. It is important, however, to note that ‘trapping’ need not 
always mean a real trap or cage in the physical space, it might as well refer to effective trapping 
in some region of the phase space (cf. Fig. [^. 

The biased random walk discussed in the previous section can be seen as a paradigmatic 
example of this phenomenon — if the driving affects the reactivities in such a way that the escape 
rate is a decreasing function of the drive, then the current shows a non-monotonic behaviour. 
This was discussed in detail in pun], where it was shown that indeed the frenetic component is 
responsible for the negative differential mobility. Here it suffices to mention that several models 
of interacting particle systems can effectively be mapped to this simple picture of biased random 
walk. 


3.3. Coupling with reservoir 

Our next example illustrates how the second order response picks up kinetic details of the 
coupling to a particle reservoir. 

We consider a tracer particle of mass M with position xt coupled to an equilibrium bath, in the 
sense that it obeys the Newton equation 


Mxt = -VxU{xt,'nt) =: F{xt,r]t) 


(19) 


where the p denotes a family of N degrees of freedom making the equilibrium reservoir, r] 
would typically contain position ri and velocity ri of the reservoir particles. The force F{xt,r]t) 
acting on the particle is “noisy” as the rji gets sampled from the equilibrium process which in 
back-reaction depends on the history (xg, s < t) of the particle. 

The bath degrees of freedom evolve under a dynamics where each position ri,i = 1,... ,N 
is coupled to the probe via the same U{x,r]) and possibly with other interactions while on the 
whole satisfying detailed balance at fixed temperature /3~^. For greater simplicity we take a 
coupling (in one-dimensional notation) 


Uix,r]) = ^^(x-Ui(r/))2, 
i 


F{x,rj) = Xj2iMv) - x) 
i 


so that for some function Uj(r/) 

- -^U{x,ri) 
V{ri) 


d d 

-A^Ui(T/)—Ui(77) -hx—H(r/) 

>^'^Ui{ri) 

i 


( 20 ) 


( 21 ) 


That choice implies that for the 77 —dynamics, changing the position x ^ x + dx means simply 
to add the potential V with small amplitude dx with respect to its original dynamics. The 
response below will be written in terms of that perturbing potential V. Note that 0 < A ~ 1/A^ 
to mimic a mean field coupling in which the particle couples equally with all the bath degrees 
of freedom. 


Integrating out the equilibrium bath from (19) should give rise to an effective and generalized 
Langevin dynamics for the (tracer) particle. 


Mxt = -XNx + + 6 


( 22 ) 



with the noise '■= V{r]t) — by construction dependent on the whole history 

< t). The expectation is in the //—process conditioned on a fixed particle 


[X, 


trajectory up to time t. In other words, we treat the particle trajectory as a fixed protocol in 
the dynamics for rj. The regime where our perturbation approach makes sense is when there 
occurs a time-scale separation between the characteristic times Tx of the particle and of the 


sea. To evaluate the expectation in (22) perturbatively we take as reference the stationary 


//—dynamics with fixed Xg ^ xt, s < t, the particle position at time t. In other words we have a 
time-dependent perturbation amplitude hg = Xg — xt- We apply the response formalism of [8] 
to second order, 
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+ /? y ^{V{Vs)V{T]t))xt ■ {Xs - Xt)ds 
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/ ds ds'{V{r]g) LxtV{r}gi)V{r]t))xtXg{xsi - Xt) 
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(23) 


where Lx^ is the backward generator of the //-equilibrium process at fixed particle position xt- 
The first line contains the time-local term which is the statistical force in the infinite time-scale 
separation limit between bath and particle. The expectation {■)x is in the stationary equilibrium 
for the reservoir at fixed particle position x. That statistical force will be given by the gradient 
of the equilibrium free energy constrained to x. The second line arises from the standard Kubo- 
term in linear response. It gives rise, via partial integration, to the usual friction which is 
proportional to the noise covariance (what gives the second fluctuation-dissipation relation, at 
least in the absence of the last line). The last line indeed gives the correction coming from 
second order (nonlinear) response, containing frenetic aspects. The point is that Lx generates 
the time-evolution of the reservoir (at fixed particle position x) and thus contains the microscopic 
interaction between the reservoir degrees of freedom. 


Equation (23) must be substituted into (22) for obtaining the Langevin-type effective dynamics 


of the particle. The reservoir kinetics sits already in the time-correlation functions that make 


the usual friction and noise term, but the last line in (23) adds significantly to that. The details 
of the dynamics will enter explicitly even in the Markov approximation. To the best of our 
knowledge that additional frenetic aspect has not been studied before, but we hope it will be 
experimentally visible. A similar study can be done when starting with nonequlibrium reservoirs. 
We then need to apply formula ([^ for obtaining the friction; see |28l I29j . 

We conclude this discussion with the remark that if the bath is linear, say consisting of har¬ 
monic oscillators like in Section 1.6 of Zwanzig’s book, [30], we can do an exact calculation with 
independent bath particles. Then the linear (Kubo) order for response suffices and there are 
in fact no corrections of second order. Therefore, saying it differently, forgetting about second 
order (kinetic) features in deriving the Langevin equation is like forgetting nonharmonic effects 
in the equilibrium bath. 


3.4-- Population inversion 

Our last example centres around another typical nonequilibrium phenomenon, namely popula¬ 
tion inversion. Population inversion is about being able to select a certain (output) stationary 
statistical distribution over the various available states of the system. In equilibrium, tem¬ 
perature and energy decide and we are stuck with the Maxwell-Boltzmann statistics. Driving 
conditions add flexibility. It is not however the driving itself or only the driving that decides 
the (new) stationary distribution — the reactivities or time-symmetric factors in the transition 
rates are (also) essential. A very simple example is to take a ring with L sites and a biased 






walker with rates k{x,x + 1) = axe^^‘^,k{x + l,x) = For a^; = 1 the stationary dis¬ 

tribution is uniform for no matter what E. But for large E we can basically concentrate the 
stationary distribution on whatever site x we want by a suitable choice of Ux- We believe that 
such a mechanism of kinetic selection is widespread in bio-chemical systems for better efficiency 
in getting the right output product. Since that mechanism is time-symmetric and works (only) 
out-of-equilibrium we call it again frenetic. Similarly, for the origin of laser working one needd to 
produce a population inversion. It is well-known that at low temperatures, a suitable choice of 
symmetric prefactors can select any desired (even high) energy level of a multilevel system [3T] , 
so as to establish an inversion of the population with respect to the usual Boltzmann statistics. 
Next we investigate how this population inversion affects the energy transport in a spatially 
extended system. Such energy transport can now show unusual features which ultimately go 
back to frenetic aspects playing a role in the energy reservoirs. In fact we will drive one energy 
bath out-of-equilibrium and enforce in it a population inversion. 



Figure 6. Schematic representation of the multilane particle transport model coupled to two 
thermal reservoirs (with K = 3). 


The model is defined on a two-dimensional lattice; the horizontal direction is interpreted as 
space and the vertical one as energy. The different energy levels are spatially invariant and we 
refer to them as lanes. Following this convention a L x K lattice corresponds to a spatially 
extended one-dimensional system with L sites, each site having K possible energy levels having 
energies Ei < E 2 ■ ■ ■ < Ex- Each site on this lattice can accommodate any number of particles; 
the configuration of the system is fully specified by the set G [T],£ G [.^i^])} where nu is 

the number of particles at the level of the site. We suppose that energy is conserved in 
the bulk, he., particles cannot change lanes there; it can only hop to its neighboring sites on the 
same lane with some rate which we take to be unity here. A particle can jump across the energy 
lane at the left and right boundaries where the system is connected to two thermal reservoirs 
with temperatures and T/j respectively (see Fig. [^; the system can gain or lose energy when 
a particle changes the lane. We assume free particle motion at the boundary sites so that the 
jump rate is proportional to the number of particles n at the source site. (The detailed dynamics 
is specified later.) 

This system can be thought of as a simple discrete model for energy transport in an extended 
system; the particles represent energy packets which are transported across the system without 
scattering. The situation is somewhat similar to the phenomenon of stimulated Raman adiabatic 
passage [32]. When the temperatures Tj, > Tr are different, there will be an energy current 
flowing through the system which is proportional to the temperature difference (Fourier law). 

Here we are interested in the effect of population inversion on the thermal current. To this 






Figure 7. (a) The effective temperature defined in (25) for a three-level system, increasing 

with equalizing strength b. The case 6 = 0 corresponds to equilibrium where Teff = T. The 
crossing of two curves at the same F but with different Tr is a signature of the resulting 
population inversion, (b) Illustrating the meaning of effective temperature: when the right 
reservoir has an effective temperature that equals the temperature of the left reservoir, the 
energy current gets close to zero and then reverses sign. Here 6 = 0.5, F = 1 and the left 
temperature = 6. The current (Je) has been amplified by a factor for better visibility. 


end we choose the jump rates at, say, the right boundary in a way so that the highest energy 
level K becomes most populated at low temperature Tr. We also assume free particle motion at 
the boundaries. The complete dynamics is then characterized by the transition rates k{i, l\ j, m) 
of a single particle from position (f,^) to position {j,m) : 
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(24) 


The dynamics conserves the particle density p in the system but not the total energy. 


The equalizing symmetric prefactor 6 > 0 between the highest and lowest energy level along 
with the factor at the right boundary gives rise to the desired population inversion m- 

To illustrate that effect we first concentrate on the right reservoir itself — decoupled from the 
bulk. It is equivalent to a system with K energy levels where the lowest and highest levels 
are connected by an equalizer and an additional energy barrier F exists between the K and 
K — level. A good indicator of the resulting population inversion is the effective temperature 








measured from the stationary state probability of the highest and lowest levels, here defined as 


TeS = {Ek — El) 


log — 
PK 


(25) 


Fig. [7] shows that effective temperature Teg, increasing with the strength of the equalizer b. For 
a fixed F, the curve of Teg corresponding to a lower thermodynamic temperature Tr crosses that 
of a higher temperature from below signifying population inversion. The barrier F facilitates 
this phenomenon — crossing occurs for smaller b when F is increased. 




Figure 8. (a) Energy current (Je) as a function of the temperature difference AT = — Tr for 

different values of F. Here the temperature gradient is increased by decreasing T/j while Tl = 6 
is kept fixed, (b) The energy profile (e,) for different values of F for fixed Tl = 6,Tr = 1. The 
inset shows (Je) as a function of the temperature difference AT = T^ — Tr when Tr = 1 is fixed. 
Here b = 1 and the number of energy levels K = 3 and particle density p = 2.0. Also, we have 
taken = (/ — 1). 


One can expect that when this system serves as a thermal reservoir it would drive a current 
opposite to the thermal gradient which is present even when Tr = Tr. 

The quantity of interest is the total energy cnrrent through the system, 

L-l K 

= (26) 
i=l 1=1 

where denotes the particle current (net number of jumps) from z —)• i + 1 at the level. 

We have adopted the notation where the superscript to the current J indicates the spatial po¬ 
sition and the subscript indicates the energy level. Fig. [^b) illustrates the relevance of the 
effective temperature for the full system. The current flowing through the system vanishes when 
Teff ~ Tr i.e when the effective bias becomes zero. 


To calculate the response we need the usual path dependent entropy and dynamical activity, 
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Here and I 1/+1 are the net particle current (directed from £ to £ + 1*^ level) and traffic 

(total number of jumps) respectively at the right boundary between £^^ energy level and £ + 1 *^ 
level; AEi = — E^ is the corresponding energy difference between these levels. Note that 

since we are interested in the thermal response where the thermal gradient is changed by vary¬ 
ing the right bath temperature Tr we have kept only those terms which depend on Tr. The 
thermal conductivity can now be calculated from formula where and D' would be the 
derivatives with respect to A = — Tr. Once more we see that the quantity E which is re¬ 

lated to the reactivity of a particular transition appears explicitly only in the dynamical activity. 

It is easy to see that this dynamics is essentially an inhomogeneous zero range process |33j 
on a two-dimensional lattice where the hop rate Ua-y(na) from site a to 7 depends only on the 
particle number at the departure site. It is known that the stationary distribution has a product 
structure when the hop rate has the general form 

— Uoii^Tla^W^oi-y 

where Wa^y gives the probability that 7 is chosen as the target site; ^07 = 1- The dynamics 
( |24| ) satisfies this condition with Ua{n) = when a = {i,£} refers to a site in the bulk and 
Ua{n) = n^a for boundary sites; £,a being the n-independent part of the escape rate of site a, 
containing the energy dependent component of the transition rates. For example = 2 for 
bulk sites, ^^7 = 1 + b + exp {—AEi/Tr) and so on. With this identification and following [33] 
one can write the individual site weights, 




dr 


fa(n) = 

m=l 

where Qq are the solutions of the linear system of equations qa = ^■yaQ’y- 

The stationary current and density prohle pn (satisfying ^ Yli e ~ P) easily be obtained 

from this exact solution. The average spatial energy profile, defined as 

K 

{ei) = '^EiPii (29) 
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(28) 


is plotted in Fig. [^b). 

The average energy current (Jg) as a function of the temperature gradient A for different 
values of E is shown in Fig. |^a). While the thermal gradient drives a current from the left 
boundary to the right one, because of the population inversion, there is an opposing current 
due to the density gradient at the highest level. Now, the population inversion becomes more 
efficient as the right temperature Tr goes down, hence if the thermal gradient is increased by 
decreasing Tr the opposing drive becomes stronger and hence the current goes down. On the 
other hand we also expect from the above explanation that there is no negative response when 
the left temperature Tl increases. That is confirmed and shown in the inset of Fig. [^b). 

4. Conclusion 

Non-thermodynamic features appear naturally under nonequilibrium conditions. We have given 
examples how time-symmetric kinetic aspects contribute to interesting phenomenology. The new 








unifying quantity here is the dynamical activity which via its excess due to the perturbation 
correlates from second order onwards with the (excess) entropy flux and produces the frenetic 
contribntion to response. Frenetic aspects arise then for example from reactivities that are 
modified by external fields or by the nonequilibrium condition in general. 
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